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Abstract — We consider a problem where a memoryless bi- 
variate Gaussian source is to be transmitted over an additive 
white Gaussian multiple-access channel with two transmitting 
terminals and one receiving terminal. The first transmitter only 
sees the first source component and the second transmitter only 
sees the second source component. We are interested in the pair 
of mean squared-error distortions at which the receiving terminal 
can reproduce each of the source components. 

It is demonstrated that in the symmetric case, below a certain 
signal-to-noise ratio (SNR) threshold, which is determined by the 
source correlation, uncoded communication is optimal. For SNRs 
above this threshold we present outer and inner bounds on the 
achievable distortions. 



I. Introduction 



We consider the situation where a memoryless bi-variate 
Gaussian source is to be transmitted over an additive white 
Gaussian multiple-access channel with two transmitting ter- 
minals and one receiving terminal. Each of the two source 
components is fed to a different average-power constrained 
encoder. Our interest lies in the achievable expected squared- 
error distortion region. We show that in the symmetric case, 
where the source components are of the same variance and 
the transmitting terminals are subjected to the same average 
power constraint, uncoded transmission is optimal below a 
threshold signal-to-noise ratio (SNR) that is determined by 
the correlation between the source components. For SNRs 
above this threshold we provide outer and inner bounds on 
the achievable distortions. 

The problem at hand can be viewed as the Gaussian version 
of the problem addressed by Cover, El Gamal and Salehi [1] 
(see also [2] and [3]). It also appears to be closely related 
to the quadratic Gaussian CEO problem [6], [7] and the 
quadratic Gaussian two-terminal source-coding problem [4], 
[5], However, it differs in character from the CEO problem 
and from the two-terminal source coding problem in that no 
error-free bit-pipes of finite rates can be assumed. This is due 
to the fact that the source-channel separation theorem does not 
apply to our situation. Furthermore, the CEO problem focuses 
on the reconstruction of a single Gaussian random variable, 
whereas in our case the interest lies in the reconstruction of 
both source components. 



II. Problem Statement 

The time-fc output Y). G M of the discrete-time two-user 
additive white Gaussian multiple-access channel is given by 

Y k = x ltk + x 2 ,k + Z k , 

where £ M denotes the time-fc symbol transmitted by the 
first transmitter, x 2 ^ <= K is the time-fc symbol transmitted by 
the second transmitter, and Zk denotes the time-fc noise term. 
The noise terms {Z^} are independent identically distributed 
(IID) zero-mean variance-TV Gaussian random variables that 
are independent of the input sequences {x2,fc})- We 

shall consider the case where Transmitter 1 and Transmitter 2 
are average-power limited to Pi and P 2 respectively. See Q 
ahead. 

At time fc the source emits the pair {S\,ki S 2 ,k) where the 
{(S% t k, S 2 .k)} are IID zero-mean Gaussians of covariance 



Kss = 



a\ pa x a 2 
p(Jicr 2 a\ 

with p e [-1, 1], and < of < oo, i = 1, 2. 

The sequence {£i,fc} is fed to Transmitter 1 and the 
sequence {S 2 ,k} is fed to Transmitter 2. Based on the channel 
output we wish to reconstruct the source vector. The perfor- 
mance criterion we focus on is the expected squared-error 
distortions in reconstructing each of the components of the 
source vector. 

Definition 1: Given ui,<t 2 > 0, p € [—1,1], and Pi,P 2 > 
we say that the tuple [Di, D 2 , a\ , a 2 , p, Pi, P 2 ) is achiev- 
able if there exists a sequence of encoder pairs (fi , ) 



(n) 



and a sequence of reconstruction pairs 



1,2 



4 n) ) 



i = 1,2 



such that the average power constraints are satisfied 



1 , 



\\&\s:)\\ 



<Pi, i = l,2 



(1) 



and 
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(S, 



f..l' 



5 ^i,n*) 



( K fi n \s?) + ftHs2) + (z 1 ,...,z n j) 



1,2, (2) 



whenever {(£i,fc, S^fc)} aie HD zero-mean bi-variate Gaus- 
sian vectors of covariance matrix K55 as above and {Zk} 
are IID zero-mean variance-iV random variables that are 
independent of {(Si,fc, S2,k)}- Here we used the shorthand 
notation where S" denotes (Si 1, . . . , Si „) and similarly for 
S%. 

The problem we address here is, for given 
af,a%,p,Pi,P2, to find the set of pairs (£>i,.D 2 ) such 
that (D\, D 2 , o\, u\, p, Pi, P2) is achievable. 

By the symmetric version of this problem we shall refer to 
the case where a\ = <j\, where Pi = P2, and where we seek 
the set of pairs (D, D) that are achievable. That is, if we set 
a 2 = a\ = a 2 an d P = Pi= P2 then we are interested in 

D* (P, N, a 2 ,p)± sup{D :(D,D,a 2 ,a 2 ,p,P,P) 

is achievable}. (3) 

III. Preliminary Remarks 

Before discussing our results, we make three remarks re- 
garding the general nature of the problem. The firs two remarks 
show that there is no loss in generality by assuming that 
the correlation coefficient is non-negative and that the source 
components are of equal variance. As a consequence we shall 
assume for the remainder that a\ = a 2 = a 2 and that 
p € [0, 1]. The third remark addresses a convexification issue 
of the distortion regions. 

1) The optimal distortion region depends on the correlation 
coefficient only via its absolute value \p\. That is, the tu- 
ple (Di,D 2 ,a 2 ,a 2 ,p,Pi,P2) is achievable if, and only 
if, the tuple (Di, D2, of, ok, —p, Pi, P2) is achievable. 
To see this note that if (f[ n \ & n \ ^ , <f> { 2 n) ) achieves 
the distortion (Di,D 2 ) for the source of correlation 



coefficient p, then (/x , / 2 ™\ 2 ™^ ) wnere 



f[ n \s?) = f\ n, {-s? 



(«), 



and 



(Yi,...,Y n ) 



(Yi,...,Y n ) 



achieves (Di,D 2 ) on the source with correlation coef- 
ficient —p. 

2) The optimal distortions scale linearly with the 
source variances. That is, if a.1,012 are positive 
then (Di , D 2 , a\ , a 2 , p, Pi , P 2 ) is achievable if, 
and only if, (a\ D\, a 2 D 2 , afa 2 , o^a\, p, Pi, P 2 ) 
is achievable. Consequently, there is a simple 
linear transformation from the set of tuples 
(Di,D 2 ) for which (D u D 2 , a\, a\,_p, P u P 2 ) is 
achievable and the set of tuples (£>i,_D 2 ) for which 
(Di, D 2 , a\a\, a 2 a 2 ,p, Pi, P2) is achievable. 
To see this note that if (/i (n) ,/ 2 (n) ,^ n) ,^ n) ) demon- 
strate the achievability of (Di, D2, u\, a 2 , p, Pi, P2) 
then the encoders 



f\ n \S?) = fl n) {S?/a i ) z 



and the reconstructions 



(Yv 



i = l,2 



demonstrate the achievability of the tuple 
{a\Di, a\D 2 , a\a\,a\a\,p, Pi,P 2 ). 
Applying the same argument in the other direction with 
scalings by 1/ai and l/a 2 concludes the proof. 
3) The achievable distortion is a convex 
function of the power constraints (Pi,P 2 ). 
That is, if _(Di,D2,a 2 ,a^,p,Pi,P 2 ) and 
(Di,D 2 , o\, a 2 ,p, Pi, P 2 ) are achievable then 

(XD1+XD1, XD2+XD2, o\, °l,P, XP1+XP1, XP2+XP2)) 

is achievable for any A e [0, 1], where A = (1 — A). 
This follows by a simple time-sharing argument 

IV. Main Results 

We present necessary conditions as well as sufficient condi- 
tions for achievability. In certain cases they agree. The proofs 
of those conditions will be discussed in the next section. 

Our first result is a necessary condition for the achievability 
of (Di,D2,alalp,Pi,P 2 ). 

Theorem 1: A necessary condition for the achievability of 
(D 1 ,D 2 ,<7 2 ,<7 2 ,p,Pi,P2) is that 

P1+P2 + 2pJ7\P~2 



^logp 



N 



>R(Di,D 2 ), 



where the expression for R(Di, D2) varies, depending on the 
values of (Di,D 2 ). There are three cases. If (£>i,Z? 2 ) are in 
the set 

Di <a 2 (l-p),D 2 < (^(l-p^-D!)- 



a 2 -Di 



then 



If (Di, D 2 ) are in the set 

jo < Di < a 2 , 

(a 2 (l p 2 ) D 1 )-^— <D 2 < a 2 (l p 2 ) +p 2 Di), 
a — L>i ) 



then 



R(Di,D 2 ) 
( 



1 



log 2 



a\l-p 2 ) 



yDiD 2 - (pa 2 - ^(^-Di)(a^D2)) 
and if (Di, D2) are in the set 

{0 < Di < a 2 ,D 2 > <J 2 (l - p 2 ) + p 2 Di}. 

then 



1,2 



R{Di,D2) = \\og 2 fg- 



Corollary 1: In the symmetric case where P\ 
obtain 



D*(a 2 ,p,P,N)> 



T 2 P(1-P 2 )+N 
2P(l+p) + N 



2 / (l-p 2 )jV 
" 2P(l+p)+N 



P2, we 
for^efo,^ 



i.e. the channel inputs are the rate-i?; vector quantized source 
sequences. 

Theorem 3: The tuple (D±, D2, a 2 , a 2 , p, Pi, P2) is achiev- 
able whenever there exist rates R\ > and R2 > such that 
all of the following hold: 



Note: Theorem ^ can be easily extended to a much wider 
class of sources and distortions. Indeed, if the source is 
any memoryless bi-variate source (not necessarly zero-mean 
Gaussian) and if the fidelity measures di(s\, si), d 2 (s2, S2) > 
that are used to measure the distortion in reconstructing each 
of the source components are arbitrary, then the pair (Di, D2) 
is achievable with powers Pi , P2 only if 



Ri 



R ^<\ lo S2 



R2 < ^ l0 S2 



R2 < 2 l0 S2 



P 2 ) 



N 



N(l-p 2 ) 
P 2 (l-p 2 )+N 



P 2 ) 



min I(Si,S 2 ;S 1 ,S 2 ) 



(4) 



Si ,S2 \Si ,S2 

such that E 
E 



D x > cr 2 2- 2Rl 



N(l 

P1 + P2 + 2pVT\p; 

N(l~p 2 ) 
f?(l-2- 2R *) 



N 



1 



(Si - Si) 2 

(s 2 - s 2 ) 2 



1 



<D 2 , 



P 2 



D 2 > a z 2 



2 -2R 2 



l-p 2 (l-2- 2 ^) 



does not exceed 
1 



log 1 



Pi + P 2 + 2p mm JT\P 2 
N 



where p max is the Hirschfeld-Gebelein-Renyi maximal corre- 
lation between S\ and S 2 : 

Pmax = SUp E[g(S , i)/l(5 , 2 )] (5) 

where the supremum is over all functions g, h under which 

E[ 5 (5i)] = E[h(S 2 )} =0 E[g 2 (Si)] = E[h 2 (S 2 )] = 1 

(6) 

We next present two sufficient conditions for the achiev- 
ability of (Di,D 2 , a 2 , a 2 , p, Pi, P 2 ). The first is obtained by 
analyzing uncoded transmission. 

Theorem 2: For (D\, D 2 , a 2 , a 2 , p, Pi, P 2 ) to be achiev- 
able it suffices that both of the following conditions hold: 



where p = p^J{\ - 2- 2I ^){\ - 2~ 2R ^). 

Corollary 4: In the symmetric case (D, D, a 2 , a 2 , p, P, P) 
is achievable if there exists some R > satisfying 

f2P{l + p{l-2- 2R )) 



i?< 4 1 ° g2 V N(l-p 2 (l 



■N 



D > a 2 2~ 2R 



l-p 2 (l-2- 2fl ) 
1 -p 2 (l -2- 2 «) 2 ' 



(7) 



(8) 



Here the RHS of $8$ is monotonically decreasing in R. 
Evaluating Corollary |4] and Corollary ^ f° r P/N — > oo we 
get: 

Corollary 5: In the symmetric case 



lim J-D*(a 2 ,p,P,N) 

P/N^oo V N 



We conclude this section with a note on the superposition 
of the two discussed coding schemes. 



D, > a 1 



Do > 



2Pi+4pVPiP2 + (l 



P 2 )^2 



N - 2^Pi+2py/Pjp2~+ p 2 P 2 (Vl\ 



P1+P2+ PVKP2 + N 



2P 2 + ipVPTK + (1 + p 2 )Pi + N - 2v/^+VM+?A(VH 



P1+P2+ PVKP2 + N 



Corollary 2: In the symmetric case 

,Pfl- 




D*(a 2 lPl P,N) < a 2 



P 



■N 



2P(l + p) + N 
Combining Corollary [1] and Corollary |2| we obtain: 
Corollary 3: For the symmetric case, 



D*(* 2 ,p,P,N)=o- 2P{1 1,1 ] 



N 



2P{l + p) + N 1 iv L-p* 

i.e., uncoded transmission is optimal for all P/N < pj (1— p 2 ). 

The second sufficient condition follows from analyzing the 
scheme where the encoding functions /j (s"), i — 1,2, 
are randomly generated independent rate-i?; vector quantizers, 



if£<- 
N 1 



Note: We have analyzed two coding schemes; uncoded 
transmission and transmission of vector-quantized source se- 
quences. The superposition of those two schemes, analogous 
to the scheme discussed for the single-user case in [9], seems 
to yield strict improvements of the above discussed achievable 
(D\, D 2 , a 2 , a 2 , p, Pi, P 2 ). Detailed results are to follow. 

V. Notes on the Derivations 

In this section we shall try to sketch the ideas behind the 
proofs of the main results. 

The proof of Theorem consists on one hand of upper 
bounding the mutual information between the the source 



vectors and the reconstructions, and on the other hand eval- 
uating the rate distortion function for a bi-variate Gaussian 
source. The key to upper bounding the mutual information 
between source and reconstructions is to use the average power 
constraints Q and the limited correlation between the source 
components to obtain the upper bound 

1 ™ 

- Var^^S") + X 2 , k (S%)) < Pi + P 2 + 2 Py /p[K 

k=l 

M (9) 

where Xx t k(Si) is the fc-th component of f\ (S™) and 
where X 2 ^(S 2 ) is analogously defined. Once this bound is 

' (n) (n) 

established for all encoders f± f 2 satisfying the power 
constraints Q, one can derived necessary conditions for 
achievability by using the data processing inequality to upper 
bound the mutual information between the source vectors and 
their reconstructions by the mutual information between the 
transmitted waveforms and the received waveform. This latter 
mutual information is upper bounded by the capacity of the 
additive Gaussian noise channel subject to the power constraint 

Pi+P 2 + 2p^/T\P 2 . 

The rate distortion function is obtained from evaluating 
@ under the given distortion constraints and for the given 
source law Ps 1 ,s 2 - From the maximum mutual information 
theorem it follows that this minimum is achieved if and only if 
Si , S2 , Si , S2 are jointly Gaussian. The minimization problem 
is then reduced to a minimization over the set of covariance 
matrices of Si, 52, Si, S2 that satisfy the distortion constraints 
and where the submatrix in Si , 52 is the covariance matrix of 
the source. The minimizing covariance matrix can be found 
by noticing that every relevant distortion pair can be achieved, 
with minimal necessary rate, by combining a scaling of the 
source with reverse waterfilling. Let T>(R) be the set of all 
distortion pairs (di, d 2 ) that can be achieved on the source pair 
(Si, 5 2 ) with rate R, and let V C (R) be the set of (di, d 2 ) that 
can be achieved with rate R on the scaled source (5i,c52). 
The region T> C (R) corresponds to the region T>(R) scaled by a 
factor c 2 on the 52-axis. Reverse waterfilling at rate R on the 
unitarily decorrelated pair (Vi, V2) of (5i,c52) achieves the 
point (d\, d 2 ) G T> C (R) of minimal sum di + d 2 - And since R 
is the minimal rate needed to achieve [d\,d 2 ) on (5i,c5 2 ), 
and 

min 7(5i, 5 2 ; 5i, 5 2 ) = 

S ^ ,S 2 l^l ;S 2 

E[(Si-§i) 2 ]<di 
E[(S 2 -S 2 ) 2 ]<4,d 2 

min I(Si,cS 2 ;Si,cS 2 ), 

s l >S 2 \Si ,S 2 ' 

E[(S 1 -<? 1 ) 2 ]<di 
E[(eS 2 -cS 2 ) 2 ]<<i 2 

the rate R is also the minimal rate needed to achieve 
(d\,d 2 /c 2 ) on (5i,5 2 ). Hence, by choosing the appropriate 
scaling c, we can get any relevant point on the boundary 
of T>{R). The covariance matrix of (Si, S2, Si, S2) that 
achieves (d\,d 2 /c 2 ) now follows from the covariance matrix 



of (Vi, V2, Vi, V 2 ), where (Vi, V 2 ) result from reverse water- 
filling at rate R on (Vi, V2). 1 

The proof of Theorem |2] is straightforward. One merely 
considers the uncoded scheme where 

f(n) {S n ) = . .5 ), i = 1,2 

a 

and then analyzes the linear minimum mean squared-error 
estimators of Si.k from Yk. 

The proof of Theorem [3] involves an analysis of randomly 
generated independent vector quantizers for the two compo- 
nents. The proposed scheme is conceptually simple, but its 
analysis gets involved by the included epsilons and deltas. For 
the sake of clarity and brevity we shall omit these epsilons and 
deltas here. 

The encoder for the z-th, i — 1,2, source component is a 
rate-i?i Gaussian vector quantizer that scales the quantized 
sequence to meet the channel input power constraint. Its 
codebook C, consists of 2 nRi codewords that are chosen IID 
uniformly on the surface of an M™-sphere of center at the 
origin and radius ^/ner 2 (l — 2~ 2Ri ). Encoder i chooses the 
codeword u* in the codebook C,; that is closest (in Euclidean 
distance) to the source sequence Sj = (sj,i, Si,2, ■ ■ ■ , Si,n)> an d 
transmits its scaled version 

Xj = an argminllsi - u|| 

= oti argmax (si, u) , 
ueCi 

where 

and where (•, •) denotes the standard inner product in M". The 
distance ||sj — u*| between the source sequence Sj and its 
closest codeword u* approaches, with high probability, a 1 ■ 
2~ 2Ri as the blocklength n tends to infinity. It can be shown 
that, for large n, the correlation coefficient between the chosen 
codewords U* and U2 is, with very high probability, close to 

p = P\f(l -2- 2 «i)(l-2- 2fl ' 2 ). 

This coefficient p plays a central role in this coding scheme. 

The decoding is performed in two parts. First the transmitted 
codeword pair is recovered, and then this codeword pair is used 
to make linear estimates of the source sequences. To recover 
the transmitted pair (u^u^), the decoder seeks, among all 
"jointly typical" pairs (ui, u 2 ) G Ci x C 2 , i.e among all pairs 
satisfying 

(ui,u 2 ) «p||ui|| ||u 2 || , 

the codeword pair (ui,U2) £ Ci x C2 whose weighted sum 
aiiii + ci!2U 2 has the smallest angle to the channel output y, 
i.e. 

f . - v / "lUi + a 2 u 2 y \ 

(ui, u 2 ) = argmax ( ■ -, — ) . 

(ui , U2 ) eCl xc 2 : \||aiui +a 2 u 2 || ||y||/ 

(ui,U2>«p||ui||||u 2 | 

1 We note that this idea generalizes to Gaussian sources with more than two 
components. 



The corresponding source estimates are then 

si = /3iui + 71 u 2 
s 2 = (3 2 in + 72 u 2 , 

where the coefficients pi, 71, /3 2 , 7 2 are chosen such that 
(§i,s 2 ) would form the minimum mean squared-error es- 
timates of (si,s 2 ) if 5*1, S 2 , U2 were zero-mean joint 
Gaussians with correlation coefficients 



p(S 1 ,S 2 ) = p, 



p(S lt Ut) = VI- 2-2*1 



-27?,! 



t/ 2 *) = pVl-2-^, p(S 2 , Ut) = pVT 
p(S 2 ,Ui) = VI -2-™*, p(Ut, Ui ) = p. 

The analysis of the three error events {ui 7^ uf , u 2 = U2}, 
{ui = uf, u 2 7^ u 2 }, and {ui ^ uj, u 2 7^ u?;} gives that re- 
liable transmission of the pair (u*, u 2 ) is possible for all rates 
(Ri,R 2 ) in the region 2 



{R u Ri):Ri < -log 2 



P 2 ) 



N 



iV(l-p 2 ) 
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R 2 < - log 



P 2 (l-p 2 ) + iV 
N(l-p 2 ) 



Ri + R2<7} lo S2 



Pi + P 2 + 2pyT\P 2 
N(l-p 2 ) 




It can then be shown that for all (Ri, R 2 ) € 1Z, the proposed 
sequence of schemes achieves the distortions 3 



D 2 



a 2 2 



a z 2 



- 2 Ri 



-2R 2 



1- p 2 {l-2- 2R *) 
l-p 2 (l-2- 2 «i) 



P 2 
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